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Distributed Evaluation and Convergence of 
Self-Appraisals in Social Networks 
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Abstract —We consider in this paper a networked system of 
opinion dynamics in continnous time, where the agents are able 
to evaluate their self-appraisals in a distributed way. In the model 
we formulate, the underlying network topology is described by a 
rooted digraph. For each ordered pair of agents {i,j), we assign 
a function of self-appraisal to agent i, which measures the level 
of importance of agent i to agent j. Thus, by communicating only 
with her neighbors, each agent is able to calculate the difference 
between her level of importance to others and others’ level of 
importance to her. The dynamical system of self-appraisals is 
then designed to drive these differences to zero. We show that 
for almost all initial conditions, the trajectory generated by this 
dynamical system asymptotically converges to an equilibrium 
point which is exponentially stable. 


I. Introduction 

Social network is a social structure made up of actors, such 
as agents and organizations, and the relationships between 
these actors, particularly those that are neighbors to each 
other. The concept of social networks is familiar to most 
people because of the emergence of online social network¬ 
ing services such as Facebook, Twitter, and Google-t. Many 
social behaviors spread through social networks of interacting 
agents. Examples are opinion dynamics ||T], adoption of new 
technology or products Q, voting Q, and demonstrations 0. 
In this paper, we will focus on an important issue in opinion 
dynamics which is about how each agent in the social network 
evaluates her importance in a distributed way. 

Over the past decades, there has been considerable attention 
paid to understanding how an agent’s opinion evolves over 
time. In social science, various models have been proposed 
to illustrate opinion dynamics. Notable among them are the 
four classical models; the DeGroot model |[T], the Friedkin- 
Johnsen model 0, the Hegselmann-Krause model 0, and 
the Deffuant-Weisbuch model 0 - In the DeGroot model, 
each agent has a fixed set of neighbors and takes a convex 
combination of her own opinion and the opinions of her 
neighbors. The Friedkin-Johnsen model is a variation of the 
DeGroot model in which each agent adheres to her initial 
opinion to a certain degree, which can be interpreted as her 
level of “stubbornness”. The Hegselmann-Krause model and 
the Deffuant-Weisbuch model define the neighbor sets in a 
different way: each agent takes a set of agents as her neighbors 
only if the opinions of these agents differ from her by no 
more than a certain confidence level. With the defined set 
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of neighbors, each agent takes a convex combination of her 
own opinion with either (i) all of her current neighbors in 
the Hegselmann-Krause model, or (ii) only one of her current 
neighbors in the Deffuant-Weisbuch model. Other important 
opinion models are, for example, the Sznajd model |[8), which 
uses the Ising spin model to describe a mechanism of making 
a decision in a closed community, and the voter model, which 
is a continuous-time Markov process defined over a lattice of 
integers, proposed by 0, m 

Recently, with the rapid expansion of large-scale, online 
networks, there has been an increased interest in the analysis 
of opinion formation, with the objective of extending the 
classical models by taking into account more factors of social 
interactions di-ID. In the work of m and fTS) , the effects 
of the existence of stubborn agents-the agents who never 
update their opinions-are investigated in a randomized pair¬ 
wise updating process. In ]T3| , the opinion formation process 
is reformulated into a local interaction game, and the concept 
of stubbornness of an agent regarding her initial opinion is 
introduced. The Krause model and its variations are studied 
in iD-d)- For example, a game-theoretic analysis of the 
Krause model is studied in ID- The work of i fTTl takes into 
account exogenous factors, such as the influence of media, 
and assumes that each agent updates her opinion via the 
opinions of the population inside her “confidence range” and 
the information from an exogenous input in that range. In the 
literature, both discrete-time 0,0 and continuous-time | |M| , 

1211 approaches have been adopted to model the update rule 
of opinions of agents. 

Recently, Jia et al proposed the so-called DeGroot-Friedkin 
model ID’ID- This model uses the concept of reflected ap¬ 
praisal from sociology | [22) , | |23] , and studies the evolution of 
self-confidence, i.e., how confident an agent is in her opinions 
on a variety of issues. Briefly speaking, reflected appraisal 
describes the phenomenon that agents’ self-appraisals are in¬ 
fluenced by the appraisals of other agents on them. Following 
the work of ID’ ID’ a modified DeGroot-Friedkin model 
is proposed in p4[ in which each agent updates her level of 
self-confidence in a more frequent manner. Specifically, all 
the agents in the network update their own levels of self- 
confidence immediately after each time of discussion, instead 
of waiting for the opinion process to reach a consensus on 
any particular issue, which generally takes infinite time. The 
analysis of the modified DeGroot-Friedkin model is carried out 
only in the special case when the so-called relative interaction 
matrix is doubly stochastic. Yet, a complete understanding of 
the system behavior for the most general case has remained 
open. 

We introduce in this paper a continuous-time self-appraisal 
model whereby the agents in a social network are able to 



evaluate their self-appraisals in a distributed way. For each 
ordered pair of agents i and j, we assign a function of self¬ 
appraisal to agent i, which measures the level of importance 
of agent i to agent j. With local interaction with her neighbors 
only, each agent is able to calculate the difference between her 
level of importance to others and others’ level of importance 
to herself. The proposed dynamical system of self-appraisals 
aims to drive these differences to zero. 

Although many opinion dynamics are built on discrete-time 
scales, a continuous-time model holds its merits in many ways; 
(i) a continuous-time model would be a natural choice if 
the opinions of individuals evolve gradually over time, and 
moreover, can be used to describe the limiting behavior of 
a discrete-time system if the exchange of the opinions are 
frequent enough; (ii) often, the analysis of a continuous-time 
system would be easier to carried out than a discrete-time sys¬ 
tem; and (iii) a complete analysis of a continuous-time system 
provides valuable insight into the dynamics of the discrete¬ 
time counterpart. We should note that the asymptotic behavior 
of the trajectories of the continuous-time self-appraisal model 
studied in this paper matches numerical simulations of the 
discrete-time modified DeGroot-Friedkin model, where the 
latter does not permit a thorough analysis. 

We note here that the analysis of the self-appraisal model 
has been carried out earlier in our conference paper | |25| , but 
for the case when the network topology is a strongly con¬ 
nected graph, for which the convergence of the corresponding 
dynamical system has been shown, with several of proofs left 
out. In this paper, we generalize the result to the case when 
the network topology is a rooted graph, and show that under 
some mild assumptions, for almost all initial conditions, the 
trajectory generated by the dynamical system asymptotically 
converges to an equilibrium point which is exponentially 
stable. We provide a complete analysis, as well as proofs for 
establishing this result. 

The remainder of the paper is organized as follows. In sec¬ 
tion II, we describe in detail the self-appraisal model as well 
as the motivation behind it. We also state the main theorem 
of the paper on the convergence of the self-appraisal model. 
In particular, the main theorem says that there is only one 
stable equilibrium point in the unit simplex (as the underlying 
space of the dynamical system), and moreover, for almost all 
initial conditions in the unit simplex, the trajectories of the 
dynamical system converge to that stable equilibrium point. 
Sections III-V are devoted to establishing several properties 
that are needed for the proof of the main theorem. A detailed 
organization of these three sections will be given after the 
statement of Theorem We provide conclusions in the last 
section. The paper ends with an Appendix. 

II. The Self-Appraisal Model and Main Result 

In this section, we introduce the continuous-time self¬ 
appraisal model, and state the main result of this paper. 

A. Background and notations 

By convention, the neighbor relation among the n agents in 
the network is characterized by a directed graph (or digraph) 


G = {V,E), with V = n} the vertex set and E 

the edge set. We consider in this paper only simple directed 
graphs, that is directed graphs with no self loops, and with at 
most one edge between each ordered pair of vertices. Denote 
by i j a directed edge of G in which i is the start-vertex and 
j is the end-vertex, and we say that j is an outgoing neighbor 
of i and i is an incoming neighbor of j. Denote by and 
the sets of incoming and outgoing neighbors of i, respectively. 
A directed path (or simply path) of G is a sequence of edges 

connecting vertices of G, and all the vertices in the path are 
distinct from each other. A vertex i is said to be a root if for 
any other vertex j, there is a directed path from j to i in G. 
The digraph G is said to be rooted if it contains at least a 
root, and strongly connected if each vertex of G is a root. 
For a subset V' C V, we call G' a subgraph of G induced by 
V' if G' = {V',E') and E' contains any edge of E whose 
start-vertex and end-vertex are in V'. Denote hy Vr GV the 
collection of roots of G, and denote by Gr = {Vr,Er) the 
subgraph of G induced by Vr- It is well known that the digraph 
Gr is strongly connected. 

Denote by Sp[y] the (n— l)-simplex contained in M" with 
vertices the standard basis vectors ei,..., e„ G K". For V' C 
V, we define similarly Sp[y'] as the convex hull of {e^ | z G 
V'}, i.e.. 



A point a; G Sp[y] is said to be a boundary point of Sp[l^] 
if Ti = 0 for some z G F. If V is a proper subset of V, then 
each X G Sp[y'] is a boundary point of Sp[F]. 

For an arbitrary dynamical system x = f{x) in M", a subset 
Q C M” is said to be positive invariant if for any initial 
condition a;(0) G Q, the solution x{t) of the dynamical system 
is contained in Q for all time t > 0. 

B. The self-appraisal model 

To introduce the self-appraisal model, we first consider the 
following opinion consensus process, as a variation of the 
DeGroot model Q, in continuous-time: Let G = (L, E) be 
a rooted graph; each vertex z of G has at least one outgoing 
neighbor. The opinion consensus process is described by 

Zi{t) = (1 - Xi{t)) I -Zi{t) -f ^ CijZj{t) I . (1) 

\ few / 

Each Zi{t) is a real number (or vector), representing the 
opinion of agent i on certain ongoing issue(s) at time t. The 
number Xi{t) G [0,1] represents the current self-appraisal of 
agent z in the social network. The coefficients c^’s, termed 
as relative inter-personal weights in H), are positive real 
numbers, satisfying the following condition: 

^ = 1, Vz G E. (2) 


Each Cij can be set by agent i herself, encoding the willingness 
of agent i to accept the opinion of agent j. Alternatively, 
can be also viewed as a measure of the influence of the opinion 
of agent j on the opinion of agent i. 

We then recognize that system Q, with condition (|^, is 
a continuous-time consensus process p6) , with the dynamics 
of Zi{t) scaled by the non-negative factor (1 — Xi{t)). Note 
that in Q, a larger value of Xi{t) implies a smaller value of 
|ji:i(f)||. So then, (1 — Xi{t)) can be viewed as a measure of 
the total amount of opinions agent i accepts from others at 
time t, and Cij{l — Xi{t)) is the corresponding portion agent i 
accepts from agent j. 

With the opinion consensus-process ([T]) in mind, we propose 
the following dynamics for the evolutions of self-appraisals; 


Xi (1 x-i'jx-i -f ^ ^ ^^ 2(1 Xj')Xj^ Vt € E. (3) 


Similar to the works 1181, p4) , the self-appraisals are scaled 
so that they sum to one, i.e.. 


X := {xi, ...,Xn) e Sp[E]. 


Note that such a scaling will be effective along the evolution; 
indeed, we show in the next section that Sp[E] is a positive 
invariant set for system 

We now justify the self-appraisal model introduced above. 
From 02 the evolution of Xi is determined by two terms; 

Cji(l — Xj)xj and (1 — Xi)xi. Explanations of these 
two terms are given below. 

Each summand Cji{l — Xj)xj in the first term is a product 
of two factors; one is Cji{l — Xj) which measures the amount 
of opinion agent j accepts from agent i during the consensus 
process (0, and the other factor Xj is the self-appraisal of 
agent j which reflects the importance of agent j in the 
network. Thus, their product Cji{l — Xj)xj can be viewed as 
the measure of importance of agent i to agent j. Of course, 
there are numerous ways of modeling these two factors, the 
rationale behind the choice of using the product is given below. 

We first consider the case where Xj = 0; then agent j is not 
important at all in the social network, and thus, agent i will 
not increase her self-appraisal regardless of how much opinion 
agent j accepts from her. On the other hand, consider the case 
where Xj = 1; then from the consensus process, we see that 
agent j will not accept any opinion from agent i. Thus, in this 
situation, agent i will not increase her self-appraisal either 
regardless of how important agent j is in the network. By 
taking these two cases into account, we realize that Cji{l — 
Xj)xj may be one of the simplest expressions that realistically 
models how the neighbor j affects the self-appraisal of agent i. 

The summation ~ ^ 3)^3 viewed 

as the measure of importance of agent i to others. Conversely, 
by Q, the other term (1 — Xi)xi can be expressed as follows; 

{l-Xi)Xi= ^ Cij{l-Xi)Xi, 

few 

We thus interpret (1 — Xi)xi as the measure of importance 
of others to agent i. Note that by communicating with her 
neighbors, each agent i is able to compute these two terms by 
herself 


The self-appraisal model is then designed so that agent i 
measures the difference of the two terms, and drives it to 
zero. In particular, note that if x* is an equilibrium point 
of system 0, then for each agent i, we have the balance 
equation; 

{^-x*)x*= Cj,{l-x*)x*. 

3 &V+ 

In other words, at an equilibrium point, the importance of 
agent i to others is equal to the importance of others to agent i. 

C. The main result 

In this subsection, we state the main result of the paper. We 
first recall that the coefficient Cy can be viewed as a measure 
of the influence of the opinion of agent j on the opinion of 
agent i. The larger the value of Cij is, the more influential is 
agent j on agent i. We call agent j a dominant neighbor of 
agent i if Cy > 1/2. Note that in this case, because of (|^, we 
have 

in other words, the influence of agent j on agent i exceeds the 
influences of all the other neighbors of agent i together. Note 
that if an agent i has agent j as its unique outgoing neighbor; 
then, by (|^, we have = 1, and hence agent j is a dominant 
neighbor of agent i; indeed, in this case, agent i can only take 
opinions from agent j. On the other hand, if agent i has at 
least two outgoing neighbors, then, the coefficients Cij, for 
J G can be set by agent i in a way so that there is no 
dominant neighbor of agent i. 

We assume in this paper that agents in the network act 
cautiously when taking opinions from others so that there is 
no dominant neighbor in the network. Specifically, we assume 
that each vertex i of G has at least two outgoing neighbors. 
Moreover, the coefficients c^, for i ^ j G E, are such that 

^ij ^ ^^ j ^ E. 

We formalize below the following facts about the self-appraisal 
model; (i) There is a unique stable equilibrium point x* ;= 
{x\, ..., x*) of system (|^ in Sp[E]; (ii) Almost all trajectories 
x{t) converge to x*, and hence x* can be interpreted as the 
steady state of the self-appraisals of the agents in the network, 
independent of their initial conditions; (iii) The self-appraisal 
X* is zero if vertex i is not a root of the graph G. Furthermore, 
we have x* < 1/2, for all i G V. This, in particular, implies 
that in the steady state, we have x* < i-®-’ there is 

no single agent whose self-appraisal is greater than or equal 
to the sum of the self-appraisals of the remaining agents. 

We now state the main result in precise terms. We first 
summarize the key conditions for system 02 which will be 
assumed in the remainder of the paper; 

Assumption 1. The digraph G = {V, E) is simple and rooted, 
with Vr the set of roots. Each vertex i of G has at least two 
outgoing neighbors. The coefficients Cij of 0. for i ^ j G E, 
satisfy the following conditions: 

Y ^1.3 = I2 Vi G V, 

3 ev- 



and 


We now have the main result, captured by the theorem 
below; 

Theorem 1. Under Assumption^ the self-appraisal model ([^ 
satisfies the following properties: 

1) The unit simplex Sp[y] is a positive invariant set. 

2) There are (n + 1) equilibrium points of system Each 
of the n vertices o/Sp[V^] is an unstable equilibrium 
point. The remaining equilibrium point x* lies in Sp[14]. 
and satisfies the following condition: 

Q<x*< 1/2, Vi G Vr. 

Moreover, x* is exponentially stable. 

3) For any initial condition a;(0) other than a vertex of 
Sp[y], the solution x{t) of system •HI) converges to x*. 

Remark 1. Note that the cascaded system Q and admits 
a triangular structure (i.e., ^ feeds into ([T]) but not the other 
way around), and hence the convergence of system 01 implies 
the convergence of the consensus process Q- 

We note here that the self-appraisal model ([^ is similar, in 
its format, to the replicator dynamics (see, for example, 

|[2^), which is also defined over the unit simplex. Yet, 
these are two different types of dynamical systems. Indeed, 
a replicator dynamics equation is given by 

Xi = Xi\ gi{x) - ^ Xjgj{xj) , Wi £ V. (4) 

V jev J 

First, note that the dynamics of each Xi in Q depends on a 
global information of x. Yet, in the self-appraisal model ([^, 
the dynamics of Xi depends only on Xj for j G 14^. Second, 
note that for the replicator dynamics, each subset Sp[l^'], for 
V' C V, is a positive invariant set; indeed, from 0 , if Xi = 
0, then Xi — 0. Yet, such an invariance property does not 
hold in the self-appraisal model; indeed, from Theorem if 
Sp[F'] is positive invariant, then, either V = {ci} for some 
i £ V, OT V' contains the root set 14 (we prove this fact 
formally in the next section). We further note that if G is 
a strongly connected graph, then Vr = V, and hence from 
Theorem [T] there is a unique stable equilibrium point of 0 
in the interior of the simplex. For the replicator dynamics, a 
stable equilibrium point may or may not lie in the interior of 
the simplex (see, for example, |[^). All these facts point to 
the intrinsic differences between the two types of models. 

On the other hand, the self-appraisal model 0 can be 
viewed as a prototype of a general class of nonlinear dynam¬ 
ical systems defined over the unit simplex: 

Xi = -gi(xi) + ^ Cjigj{xj). 

with gi{x) > 0 and gi{0) = gi{l) = 0 for all i £ V. Hence, 
the analysis of system 0 provided in the paper, for locating 


the set of equilibrium points and for establishing the global 
convergence, might be of independent interest. 

The remainder of the paper is now devoted to establishing 
properties of system 0 that are needed to prove Theoremfl] In 
section III, we focus on some basic properties of system 0! In 
particular, we construct a family of subsets of the unit-simplex 
each of which is a positive invariant set for system 0. In 
section IV, we focus on the system behavior around a vertex 
of the simplex. We show that there is a closed neighborhood 
around each vertex in the simplex such that if the initial 
condition is not the vertex, then the solution of system 0 
will be away from that neighborhood after a finite amount of 
time. In section V, we establish the global convergence of the 
self-appraisals towards the unique stable equilibrium point. 

III. Basic Properties of the Self-Appraisal Model 

In this section, we compute time-derivatives along trajec¬ 
tories of system 0 at boundary points of the unit simplex. 
We then exhibit a family of subsets of Sp[V] (including 
the simplex itself), each of which is positive invariant for 
system 0. 

A. Time-derivatives at boundary points 

In this subsection, we assume that Xiif) = 0, for some 
i £ V, and evaluate the time-derivatives d^Xi{t)/dt^, for k > 
1. We first establish in this subsection the following fact: let 
d^Xi{f)/dt^ be the first non-vanishing time derivative, i.e., 
d^Xi{t)/dt^ f 0 and d}xi{t)/df' = 0 for all I < fc; then, 
we have d^Xi{f)/dt^ > 0. Toward that end, we first introduce 
some definitions about the graph G: 

Definition 1 (Supporting set). For a vertex i £ V, a set Si C 
V is a supporting set, if a vertex j is in Si whenever there 
is a path from j to i. The vertex i is in St by default. 

Note that if i is a root of G, then Si = V. Indeed, if j £ Si, 
then so is any vertex in . 

Let 7 be a path in G, and ^(7) denote its length. For each 
non-negative integer k, we define Si{k) C Si as follows: if 
j £ Si{k), then there is a path 7 from j to i with l{y) < k. 
We assume that i £ Si{k) for all k > 0, and 5^(0) = {z}. By 
definition, we have Si{k — 1 ) C Si{k) for all fc > 1. Denote 
by Di(k) the difference between Si{k) and Si{k — 1), i.e., 

Di{k) ■.= Si{k) - Siik - 1)-, (5) 

for A: = 0, we set DiifS) := {i}. Note that in the case fc = 1, 
we have S'i(l) = {i} U 14^, and hence Di{l) = We 
further note the following fact: 

Lemma 1. Let j £ Di(k) for some fc > 1. Then, V~ intersects 
Si{k — 1) and their intersection lies in Di{k — 1). 

Proof. First note that if j £ Di{k) and 7 is a path from j 
to i of shortest length, then l{'j) = k. Since j £ Di{k) for 
k > 1, there exists at least one vertex j' G V~ such that 
j' £ Si{k— 1), because otherwise the length of any path from 
j to i is greater than fc. Now let j' G V~ n Si{k — 1), and 7' 
be a path from f to i; it suffices to show that ^ 7 ') > (fc — 1 ). 
We prove by contradiction. Suppose that ^( 7 ') < (fc — 1); then 


by concatenating j —>■ / with 7', we get a path 7 from j to 
i with ^( 7 ) < k, which contradicts the fact that j G Di{k). 
This completes the proof. ■ 

Let j G Di{k), and denote by rji{k) the collection of paths 
from j to i of length k. Choose any path 7 G and write 

1 = jk^ jfc-1 jl jo 

with jk = j and jo = i. Then, each ji lies in the intersection 
of Si{l) and Thus, by Lemmawe have 

jiGDS), yi = o,...,k. 

For each 7 G Tji^k), define a positive number as follows: 

Trfc 

We further define 

Oiji . ^ ^ O.'y . ( 6 ) 

7er,,(fc) 

Note that aji can be defined recursively as follows: For the 
base case, we assume that j G Di{l) = then, rj 7 (l) is 
a singleton, comprised only of the edge j -G i, and hence 
aji = Cji- For the inductive step, we assume that k > 1 and 
aj'i, for j' G Di(k— 1), are well defined. Let j G Di{k), then 

Uji = (7) 

j' 

where the summation is over V~ n Di{k — 1 ), which is 
nonempty by Lemma 

To state the main result of this subsection, we further need 
the following dehnition: 

Definition 2 (Supporting path). Let x G Sp[y] with Xi = 0 
for some i G V. A path 

1 '■= jk ^ ^ ji ^ i 

is a supporting path for i at x if 

I > 0 

\ Xj, =0 \/l < k. 

If in addition, k is the least integer among the lengths of all 
supporting paths for i at x, then 7 is a critical supporting 
path. 

It should be clear that if there exists a supporting path for i 
at x, then there will be a critical supporting path. Note that 
all critical supporting paths for i at a; have the same length. 
We have, however, also the following fact: 

Lemma 2. Let x G Sp[I7] with Xi = 0. If there is no 
supporting path for i at x, then Xj = 0 for all j G Si. 

Proof We prove the result by contradiction. Suppose that 
there exists some j G Si such that Xj 0. Then, by the 
construction of the set Si, we can choose a path 7 from j to 


1 = j ^ jk-l -G ^ ji ^ i. 

By truncating the path if necessary, we can assume that Xj^ = 
0 for alH = 1,..., fc — 1. Then, 7 is a supporting path for i 
at X, which is a contradiction. ■ 


With the preliminaries above, we compute below the time 
derivatives of Xi{t). For convenience, let 

■= d^Xi{t)/dt^. 

We then have the following fact: 

Proposition 1. Let the initial condition a;(0) of system (|^ be 
in Sp[y], other than a vertex. Suppose that 3 :^( 0 ) = 0 for 
some i G V. Then, the following properties hold: 

1. If there does not exist a supporting path for i at a;(0), 
then, i ^ Vr and Xi (t) = 0 for all t > 0. 

2. If there is a critical supporting path for i at a;(0), and 
the length of the path is k, then, 

xf\0)=0 

for all I < k, and 

jeDiik) 

with Di{k) defined in and otji defined in ( 1 ^. 

We refer to the Appendix for a proof of Proposition 


B. Positive invariant sets 

Now, for each subset V' C V, we define 


Sv := yJic,v'Si. ( 8 ) 

If V is empty, then so is Sy' ■ Note that if V' contains a root 
of G, then Sy' = V- Denote by Sy, the complement of Sy 
in V, i.e., 

S^, —V -Sy. 

Then, the set Sp[S'{>,] can be described by 

Sp[5'^,] = {xG Sp[y] \x, = o,yiG 


We next establish the following fact: 


Proposition 2. Let V be any subset ofV. Then, Sp[S'y,] is 
a positive invariant set for system 0 - 

Proof. First, note that if a;(0) G Sp[S'y/], then there is no 
supporting path for i at x(0) for all i G Sy. Then, by 
Proposition [2 we have 

Xi{t) =0, Vf > 0 and Vi G Sy. 


Next, we show that invariant along the evolution. 

To see this, note that 

^i—l{^~Xi)Xi = ^i—i^j^y- Cij{l — Xi)Xi 

~ ^i=i^jevf ~ ■ 

Hence, we have 




\3ev+ 



= 0 . 


Thus, Xi{t) = 1 for f > 0. It now suffices to show that 


Xi{t) >0, Vf > 0 and Vi G V. 


We prove this by contradiction. Suppose that, to the contrary, 
there exists a vertex i G y, an instant t > 0 and an e > 0 
such that Xi{t) = 0 and 


Proposition 3. Suppose that for a vertex i ^V, there exists 
e G (0,1) such that cji < efor all j G V^'^. Then, there exists 
an ai G (0, e) such that fi{x) < 0 for all x G Pi{cxi) — {ci}. 


Xi{t')<0, y t'G (t,t + e). (9) 

There are two cases: 

Case I. Suppose that there does not exist a supporting path 
for i at x{t); then, by Proposition Xiit') — 0 for all t' > t, 
which contradicts 

Case II. Suppose that there is a supporting path for i at 
x{t); then, appealing again to Proposition [T] we have that there 
exists a k such that xf^'^ (t) > 0 and xf^ (t) = 0 for all I < k. 
This, in particular, implies that there is an e' > 0 such that 
Xi{t') > 0 for all t' G {t,t + C), which contradicts (|^. This 
completes the proof. ■ 

We state below some implications of Proposition First, 
let V' be an empty set; then Sy, = V. Thus, we have the 
following fact as an immediate consequence of Proposition 

Corollary 1 . The unit simplex Sp[y] is a positive invariant 
set for system 

Recall that Vr is the root set of G; we establish the following 
fact as another corollary to Proposition 

Corollary 2 . The subset Sp[T4] o/Sp[y] is a positive invari¬ 
ant set for system 

Proof Let V := V — Vr', we prove the result by showing 
that Syi = Vr, and then, appealing to Proposition]^ It should 
be clear that Sy, C Vr, and we prove that Sy, D Vr- The 
proof is carried out by contradiction. Suppose that there is a 
root i G Sv' ■ From ([^, we know that there is a vertex j G V , 
together with a path 7 from i to j. But then, since * is a root, 
each vertex of 7 is a root. In particular, we have that j G Vr, 
which contradicts the fact that j G V . This completes the 
proof ■ 


IV. Vertices Are Repellers 

In this section, we focus on the system behavior around a 
vertex of the simplex. First, observe that each vertex G K" 
of the simplex is an equilibrium point of system Q. We show 
below that each Ci is unstable, and in fact, it is a repeller. To 
this end, we choose an e G (0,1), and define Pi (e) C Sp[l/] 
as follows: 


Pi{e) := {x G Sp[V] I > e}. 

It should be clear that each Pi{e) is a closed neighborhood of 
ti in Sp[V], and 

-P^(e) 2 -P.(e'), if e < e'- 

Denote by /(x) the vector field of system and by fi{x) 
the i-th component of /(x), i.e., 

fi{x) :=-{!-Xi)xi+ ^ Cji{l - Xj)xj. ( 10 ) 

jevf 

We next establish the following fact: 


Remark 2. We recall that Cji measures the influence of agent i 
on agent j. Proposition then says that if the influence of 
agent i on each of her incoming neighbors is less than e, 
then the self-appraisal Xi (t) of agent i decreases along the 
evolution and stays below e. 

Proof of Proposition^ First, note that if vertex i does not 
have any incoming neighbor, then 

Xif 

and hence, fi{x) < 0 as long as Xi G (0,1). Hence, in this 
case. Proposition 1^ holds for any a, G (0, e). We thus assume 
that Vi'^ is nonempty for the rest of the proof. 

To prove the result, we first apply the condition that Cji < e, 
and obtain 


Mx) < -(1 - Xj)xi + - Xj)xj. ( 11 ) 

Now, fix the value of Xi, and consider the following optimiza¬ 
tion problem: 

max^^.g^+(l-Xj)xj 

s.t. Xj < I — Xi and Xj > 0 . 

Since the function ~ Xj)xj is strictly concave, the 

maximum is achieved uniquely at 

Xj = (1 - Xi)/d^, Vj G 

where di is the cardinality of Thus, 


max ^ (1 - Xj)xj = (1 - Xi)(l - (1 - Xi)/di). (12) 

We then combine ( [TT] l and 0 , and get 

fi{x) < -(1 - e/(ii)(l - Xi) ^Xi - e ^ ^ . 

For the first term on the right hand side of the expression, we 
have (1 — e/di) > 0. For the second, we have that if X e„ 
then (1 — Xi) >0. For the last term, we let 


le(l-e) 
2 di — e 


(13) 


Then, we have 


_ dj-l 1 e(l - e) 
* di — e ~ 2 di — e 


> 0 , 


VXi ^ Oii. 


Combining these facts, we arrive at the result that fflx) < 0, 
for all X G Pi{ai) — {ci}. ■ 


Recall that < 1/2 for all i ^ j £ E. Thus, if we let 
e = 1 / 2 , then following (|T3]l, we have 


_ 1 1 ^1 1 
“ 2 ~ 4:{2d, - 1) - 2~ 4(2n - 3)' 

The equality holds if and only if V/^ = V — {i}, and hence 
di = n — 1. For convenience, let a be dehned as follows: 


1 1 
2 ~ 4(2n-3)' 


a := 


(14) 









It is the sharp upper-bound for all a^’s. This number a will 
be fixed for the remainder of the paper. 

Following Proposition we now describe some relevant 
properties of system ([^. First, we define a subset Q C Sp[y] 
as follows; 

Q := {x G Sp[l^] \ Xi < a,\/i & V}. (15) 

Note that Q can be expressed as follows 

Q= f|cl(Sp[f^]-P,(a)) (16) 

i&V 

where cl(-) denotes the closure of a set in K". An illustration 
of Q in the case n = 3 is given in Figure [T] 


By the fact that cl(Sp[F] — Pi{a)) is positive invariant, we 
can choose Ti = 0. We now assume that Xi(0) > a. Then, 

Pi{(y) 2 Pi{xi{Q)), 

and hence the set Pi{a) — Pi{xi{0)) is nonempty. Let 

Vi := inf {|/,(x)| | x G P,{a) - P,(Xi(0))} 

Since cl(Pi{Q!) — Pi{xi{0))) is compact over which fi{x) is 
strictly negative, we have Vi > 0. Let 

Vi 

Then, by construction, the trajectory x{t) will enter cl(Sp[y] — 
Pi (a)) in no more than Ti units of time. This completes the 
proof. ■ 



V. The Global Convergence of 
The Sele-Appraisal Model 

In this section, we establish the global convergence of 
system ([^. The section is divided into four parts: In subsec¬ 
tion V-A| we show that the self-appraisals of non-root agents 
converge to zero. In subsection V-B we establish the second 
part of Theorem i.e., there is only one stable equilibrium 
point X* of system ([^, which lies in Sp[V).], and moreover, 
0 < X* < 1/2, for all i G V/. In subsection V-C we show 
that if the initial condition x(0) of system 0 is such that 
x(0) G Q, and Xi(0) = 0 for i ^ Vr, then, the trajectory 
x{t) converges to the unique stable equilibrium point x*. 
In subsection we combine all the results and prove 

Theorem [T] 


Eig. 1. Illustration of how Pi(«)’s and Q are defined and how these sets are 
distributed over the simplex in the case n = 3. 

We obtain some results as corollaries to Proposition]^ 

Corollary 3. If x is a non-vertex equilibrium point of sys¬ 
tem 0, then X G Q. 

Proof If X G Sp[C] — Q, then x G Pi (a) for some i G V. 
Since x is not a vertex, by Proposition]^ we have /i(x) < 0. 
Thus, X can not be an equilibrium point x ^ Q. ■ 

We now show that the set Q is also positive invariant: 

Corollary 4. The set Q is positive invariant for system 0 . 
For any initial condition x(0) G Sp[y] other than a vertex, 
the trajectory x{t) enters Q in a finite amount of time. 

Proof We first show that Q is positive invariant. From 
it suffices to show that each cl(Sp[y] — Pfia)) is positive in¬ 
variant. By construction, Xi < a if and only if x G cl(Sp[C] — 
Pi (a)). On the other hand, by Proposition]^ fi{x) < 0 for all 
X G Pi{a). It then follows that cl(Sp[C] — Pfia)) is positive 
invariant. 

We now show that if x(0) Ci for any i gV, then there 
exists an instant T > 0 such that x{f) G Q for all t > T. 
Similarly, it suffices to show that for each i G V, there exists 
an instant Ti > 0 such that x{t) G cl(Sp[C]— Pi(a)) for all t > 
Ti- First, note that if Xi(0) < a, then x G cl(Sp[C] — Pfia)). 


A. Convergence of self-appraisals of non-root agents 

An agent i is said to be a non-root agent if i is not a 
root of G. We establish in this subsection the result that the 
self-appraisals of non-root agents decay to zero. 

Proposition 4. Let x(0) G Sp]y] be other than a vertex. Then, 
Xi(t) converges to Q for all i ^ Vr. 

To prove Proposition ]2 we first etablish the following fact: 

Lemma 3. If Xi (t) converges to 0, then so does Xj (t) for all 
J e 

Proof. We prove Lemma ]^ by contradiction. Suppose that 
there is a vertex j G such that Xj (t) does not converge to 
0. Then, there is an e G (0,1/2), and an infinite time sequence 
{tfcjfcGN with limfe_).oo ffc = oo such that Xjifk) > e for all 
fc G N. 

Since there is an upper bound for \fj{x) \ for all x G Sp[y], 
there is a finite duration time r > 0 such that 

Xj{tk + t') > e/2, Vr' G J0,t] and VA: G N. 

Rescale r, if necessary, so that r < 1. On the other hand, by 
Corollary]^ there exists an instant T >0 such that x{t) G Q 
for all t >T. This, in particular, implies that Xj (t) <1/2 for 
all t > T. Without loss of generality, assume that tk >T for 
all fc G N, and hence 


x,(f)G [e/2,1/2] 












for all f S [ffe, ffe + r] and for all fc € N. It then follows that 

Cjj(l - Xj{t))xj(t) > Cji(l - e/2)e/2. (17) 

for all t G [tk,tk + t] and for all fc G N. 

For convenience, let 6 := Cji{l — e/2)e/2. Since Xi{t) 
converges to 0, there is an instant T' such that 

x,{t)<T8/2, yt>T'. (18) 

Using the fact that t < 1 and (1 — a;i(f)) < 1, we obtain 

{l-x^{t))x^{t) <5/2, Wt>r. (19) 

We recall that fi{x) (defined in ( fTO) !) is given by 

fi{x)=-{l-Xi)Xi+ ^ Cj^{l-Xj)Xj. 

Combining ( [TtI i and ([T^, we then obtain 

fi{x{t)) > 5/2, \/t G [tk,tk + t] 

as long as tk > T'. It then follows that 

r'tk+'T 

Xi{tk + t) = Xi{tk) + / fi{x{t))dt> 5t/2 

Jtk 

which contradicts This completes the proof. ■ 

Recall that S'i C U is the supporting set of i, and Si{k) C V 
is defined such that if j G Si{k), then there is a path 7 from 
j to i, with (( 7 ) < k. Also, recall that for a subset V' of 
V, we have defined Sy' = 'Oi^v'Si- In the remainder of this 
subsection, we focus on the case where V' is Vr, the set of 
roots of G. 

First, note that by the definition of Vr, we have = V; 
indeed, for any vertex j, there is a path from j to a root of 
G. Now, for each fc > 0, we define 

Sy^{k) ■— \Ji(iy^Si{k). 

For fc = 0, we have = Vr- It should be clear that 

Sy^{k — 1) C Sy^{k), and moreover, there is an integer m 
such that 

Sy^(m) = V. (20) 

We now assume that m is the least integer such that ( |20l l holds. 
Let 

Dy^(fc) := Sy,.{k) - Sy^{k - 1). 

With Lemma and the notations above, we prove Proposi¬ 
tion]?] 

Proof of Proposition ]^ We prove the proposition by subse¬ 
quently showing that 

lim Xi{t) =0, Vi G Dy^{k), 

t—fOO ^ 

for k = 1,... ,m. 

Base case. We prove for k = 1. Let fr be a function on 
Sp[U] defined as follows; 

frix) := ^ Xi. (21) 

ieVr 


We first compute the time derivative of (j>r{x) along a trajec¬ 
tory x{t) of system 0: first, let E' be a subset of E defined 
by 

E' := {i ^ j G E \ i G Dy^{l), j G Vr}', 
we then have 

^ ^ xfxi ^ 0 . ( 22 ) 

Note that by its definition ( jST] ), we have that (j)r{x) < 1 
for all X G Sp[U]. Also, note that from ( ]22| i, (j)r{x{t)) is 
monotonically increasing in t. So, limt_),oo (j)r{x{t)) exists. 

Next, we show that (j)r{x{t)) converges to 0. The proof 
will be similar to the proof of Lemma and is carried out 
by contradiction. Suppose that there exists an e, and a time 
sequence {f/c}fcgN with limfc_>.oo f/c = 00 , such that 

fr{x{tk)) > €, Vk G N. 

Note that \cj)r{x{t))\ is bounded above for any x{t) G Sp[U], 
and hence there is a duration time r > 0 such that 

fr{x{t)) > e/2, Vf G [tk, tk + t] and Vfc G N. 

By passing to a subsequence, we can assume that tk+r < tk+i 
for all fc G N. Thus, we have 

ptk+T 

lim (j)r{x{f)) — (/)r(a;(0)) > > / 4>r{x{s))ds. 

By construction, each summand on the right hand side is 
bounded below by er/2, and hence the summation is infinite 
which contradicts the fact that limt_>.oo 4>r{x{t)) exists. 

Since (pr{x{t)) converges to 0 and each summand of 
4>r{x{t)) in ( ]2^ is non-negative, we have 

lim Xi(f)(l — a:i(f)) = 0, ViGi9y,(l). 

t—fOO 

Thus, Xi{t) converges to either 0 or 1. Since a;(0) is not a 
vertex, by Corollary the trajectory x{f) enters Q in a finite 
amount of time. We thus conclude that Xi{t) converges to 0 
for all i G Dy^(l). 

Inductive step. We assume that Xj{f) converges to 0 for all 
j G Dy^fk — 1) for k > 2, and prove that Xi{t) converges 
to 0 for all i G Dy^(k). Fix a vertex i in Dy^fk)', then, from 
Lemma there is a vertex j G V~ n Dy^ fk — 1). From 
the induction hypothesis, we have that Xj{t) converges to 0. 
Since i G V/^ , by Lemma Xi{f) also converges to 0. This 
completes the proof. ■ 

B. The non-vertex equilibrium point 

In this subsection, we prove that there exists a unique non¬ 
vertex equilibrium point of system (]^. First, recall that Q is 
defined in and Sp[V/] is the convex hull spanned by e^, 
for i G Vr. We then define 

Q, :=QnSp[U,]. (23) 

From Corollaries and both Sp]!/-] and Q are positive 
invariant sets for system 0, and hence Qr is also a positive 
invariant set. We establish in this subsection the following 
result; 


Proposition 5. There is a unique non-vertex equilibrium point 
X* of system •HI), which lies in Qr, and 0 < x* < lj2for all 
i S Vr- Moreover, x* is exponentially stable. 

To prove Proposition]^ we re-write system Q into a matrix 
form. We first recall the definition of infinitesimally stochastic 
matrices: 


Definition 3 (Infinitesimally stochastic matrix). A square 
matrix A is an infinitesimally stochastic matrix if each off- 
diagonal entry of A is non-negative, and the entries of each 
row sum to zero. 


We now define an infinitesimally stochastic matrix C by 
specifying its off-diagonal entries: define the zj-th entry of C 
to be Cij if z —> j S i?, and 0 otherwise. The diagonal entries 
of C are then uniquely determined by the condition that the 
rows of C sum to zero. We note here that the negative of 
the matrix C is known as the Laplacian matrix of a weighted 
graph G, with weights for i —t j G E. 

For a vector a: in Sp[y], let X he a diagonal matrix defined 
as follows: 

X := diag(a:i,... ,a;„). 

Then, system can be rewritten into the following matrix 
form: 

x = C^{I-X)x. (24) 

For simplicity, but without loss of generality, we assume in 
the rest of this subsection that 


Vr = {l,...,k}. (25) 


Note that fc > 3, i.e., the cardinality of Vr is at least three; 
indeed, by the assumption, each vertex z of G has at least two 
outgoing neighbors, and moreover, an outgoing neighbor of a 
root is also a root. Following ( |25] l, we have that G is a lower 
block-triangular matrix: 


Gn 0 \ 
G 21 C 22 ) 


(26) 


with Gii a k-hy-k infinitesimally stochastic matrix. 

We next state some known facts about the matrix G: (i) 
Since G is rooted and Cij > 0 for all i ^ j G E, the matrix G 
has zero as a simple eigenvalue while all the other eigenvalues 
of G have negative real parts (see, for example, ©). Using 
the fact that Gn is an infinitesimally stochastic matrix, we 
have that Gn has zero as a simple eigenvalue, with all the 
other eigenvalues of Gn having negative real parts, and that 
G 22 is a stable matrix, i.e., all the eigenvalues of G 22 have 
negative real parts, (ii) Let v G K" (resp. v' G K^') be the 
left-eigenvector of G (resp. Gn) corresponding to the zero 
eigenvalue; then v = (v',0). Scale v such that 
then all entries of v' are positive, and they sum to one (see, 
for example, 113). 

We next state another relevant property of v. Recall that 
Cij <1/2 for all i —>■ j G E. It then follows that 


Vi < 1/3, Vz G V. (27) 

To see this, note that C^v = 0, and hence 


Vi = 


CiiVi 




for all i gV. Thus, 

1 1 , , 

Vi<-2_^Vj= -{I -Vi), 

from which ^ holds. 

We now return to the proof of Proposition We establish 
the proposition by first showing that the unique equilibrium 
point X* lies in Qr, with 0 < x* < 1/2 for all z G Vr, and 
then showing that x* is exponentially stable. This is done in 
Lemmas |4] and 0 below. 

Lemma 4. There exists a unique non-vertex equilibrium point 
X* of system Moreover, x* G Qr, and 0 < x* < 1/2 for 
all i G Vr. 

Proof. Note that from ( |24l l, if x* is an equilibrium point of 
system (|^, then 

- X*)x* =Q. 

Since the null space of G^ is spanned by the single vector v, 
we must have 

{I-X*)x*=gLv (28) 

for some p G K. Note that the entries of (1 — X*)x* and of 
V are all nonnegative, and thus we have p,> 0. 

We first show that x* = 0 for all i > k. Since Vi — 0 for 
all i > k, we have (1 — x*)x* = 0 for all i > k. Since x* is 
not a vertex, we have x* 1, and hence x* = 0 for all i> k. 
We now solve for x* for all i < k. Following ( (28] l, we have 

(1 — x*)x* = p,Vi, Vz < k. 

From Corollary]^ we have x* < 1/2 for all i < k. Thus, for 
a fixed p, we can solve for x* (p,) as 

^ “ a/1 - Apvi'j . 

It now suffices to show that there is a unique positive p such 
that Yl!i=i ^*{p) = 1- Define 

k 

V'(m) := 

note that z/’(0) = 0, and moreover, 4 >(p) is strictly mono- 
tonically increasing in p as long as (1 — ^pvi) > 0, for 
all z = I,... ,k. Without loss of generality, we assume that 
vi > Vi for all z > 1. Let pi := l/(4ui); it then suffices to 
show that ipipi) > 1- 

Let Wi := Vijvi, then, •fipi) can be expressed as follows: 

^ i^2 

We then consider the following optimization problem; 

maxX;L2vT — Wi 

s.t. 0 < zui < 1 and J 2 i =2 > 2. 

Note that the first constraint 0 < zxi < 1 comes from the 
assumption that Vi < vi, and the second constraint X/i =2 — 

2 follows from ( |27l l; indeed, we have 

k 

= (1 - vi)/vi > 2. 

i-2 





Since the function Vl ~ strictly concave in Wi, 

the maximum is achieved uniquely at 


= 


2 

k-1' 


Vi = 2,..., fc. 


We recall that the cardinality of the root set Vr is at least three, 
i.e., fc > 3, and hence 


which satisfies the constraint that 0 < tUi < 1. With the above 
values of Wi, for i = 2,..., fc, we have 


max E v/r^= (fc-l)Wl- ^ < (fc-2). (29) 

The last inequality in ( |29l ) holds because 

2 ^ 2 1 _ 

k-1^ “ fc - 1 (fc - 1)2 “ Vfc - ij ■ 

Following ( |29l l, we then have 

V’(Mi) > ^ 2) = 1. 

which completes the proof. ■ 

Note that in the case when G is strongly connected, the set 
of equilibrium points of system coincides with the set of 
equilibrium points of the opinion system studied in m), fig, 
though with a completely different dynamical system. 

It now remains to show that x* is exponentially stable. We 
first have some preliminaries. 


Definition 4 (Induced graphs). Let A G be an infinites¬ 
imally stochastic matrix. We say a digraph Ga = (V, Ea) of 
n vertices is induced by A if the edge set Ea satisfies the 
following condition: i ^ j G Ea if and only if the ij-th entry 
of A is positive. 


It is well known that if Ga is rooted, then A has zero 
as a simple eigenvalue and all the other eigenvalues have 
negative real parts (see, for example, p6| , p9|). With the 
notions above, we establish the following result; 


Lemma 5. Let x* be the non-vertex equilibrium point of 
system (0. Then, x* is exponentially stable. 


Proof. Let J{x*) be the Jacobian matrix of the vector field 
f{x) at X*, i.e.. 


J{x*) 


dfjx*) 

dx 


Then, by a direct computation. 


J{x*) —G^il -2X*). 


Since x* G Qr, we have 

l-2a;* > l-2a = l/(4n-6), Wi G V, 

with a defined in ([T^. In particular, each diagonal entry of 
the diagonal matrix (/ — 2X*) is positive. Let 1 G K" be a 
vector of all ones; then, we have 


J(x*)^l = (I-2X*)C1 = 0, 


and hence J(x*)^ is an infinitesimally stochastic matrix. 
Moreover, the digraph induced by J(x*)^ is the same as the 
digraph induced by G, which is G. Since G is rooted, J{x*) 
has zero as a simple eigenvalue and all the other eigenvalues 
of J{x*) have negative real parts. Let L be a linear subspace 
of K" perpendicular to the vector 1; 

L := {?; e K" I (u, 1) =0}. 

Then, L can be viewed as the tangent space of Sp[I4] at x for 
all X G Sp[y]. Note that L is invariant under J(x*), i.e., for 
any vector v G L, we have J(x*)v G L; indeed, we have 

{J{x*)v,l) = {v,J{x*yi) = 0. 

This, in particular, implies that the eigenvalues of J{x*) 
have negative real parts when restricted to L, and hence the 
equilibrium point x* of system (|^ is exponentially stable. ■ 

Proposition is then established by combining Lemmas 
and|5] 


C. System convergence over Qr 

In this subsection, we establish the convergence for a 
special class of trajectories x{t) of system These are the 
trajectories whose initial conditions are in the positive invariant 
set Qr defined in ( |2^ . Precisely, we have the following: 

Proposition 6. Suppose that the initial condition a;(0) of 
system © is in Qr,' then, the trajectory x(t) converges to 
the non-vertex equilibrium point x*. 

We establish Proposition]^ below. First, recall that we have 
labeled the vertices of G such that the root set Vr is comprised 
of the first fc vertices. Let 


x' '.= (cci,. . . .Xk) 


and similarly, define 

X' := diag(a;i,.. .,Xk). 


Note that if x G Qr, then x = {x',0). Since Qr is positive 
invariant, the dynamics of x' is simply given by 

x'= Gj^{I - X')x' (30) 


with Gii the fc-by-fc block matrix defined in ( |26] l. To prove 
Proposition it suffices to show that for any initial condition 
x'(0), the solution x'{t) of system converges to x'* := 
{xl,...,xl). 


To do so, we first make a change of variables for sys¬ 
tem Recall that Gr = {Vr,Er) is the subgraph induced 
by the root set Vr. We now define a set of new variables yfs 
as follows; 




(1 - Xi)Xi 
(1 - <)< ’ 


Vi e Vr. 


This is well defined because, from Proposition]^ we have x* G 
(0, a], and hence the denominator is nonzero. We consider 
below the dynamics of for i G Vr'. First, we define a set 
of new coefficients Cji as follows: 


Cii 




V i —y j € Ep . 


(31) 















For a vertex i G Vr, denote by the set of incoming 
neighbors of i in Gr- It should be clear that 

v+ = v+ n y.. 


With the notations above, we can express the evolution equa¬ 
tions of Ui, for i G Vr, as follows: 


y, = {I- 2Xi) 


Vi + Cji Uj , 

\ j 


yieVr. (32) 


We further describe below some relevant properties of 
system ([^i. First, note that x* G Qr is an equilibrium point 
of system (^, and hence 

Cjiil - X'*)x'* = 0, 


which implies that 


(1 - Cj-,(1 - x*)x*, Vi G K. (33) 


Combining ( [3T] i and ( |33l ), we have that the coefficients cji, for 
i ^ j G Er, satisfy the following condition: 


Y 


E 


(!-<)< 


= 1, Vi e K. 


(34) 


Also, note that Q^. is positive invariant for system ([^. Thus, 
if a;(0) G Qr, then x{t) G Qr for all f > 0; in particular, this 
implies that 


1 — 2a:i(f) > 1 — 2a > 0, Vf > 0 and Vi e K- (35) 


for a defined in ( [l4| . 

Combining ( [3^ with ( |34l i and (HU, we recognize that the 
dynamics of is a continuous-time consensus process scaled 
by a time-varying, positive factor (1 — 2xi(t)). Now, define a 
ic-by-A: infinitesimally stochastic matrix A{x') = (aij(x')) as 
follows: for i ^ j, let 


J (1 — 2xi)cji if j —>■ i G Er 
y 0 otherwise. 


(36) 


Moreover, following ( [T5] l, we obtain 

> (1 ~ 2a)cji, Vt > 0 and VJ —>■ i G Er- (39) 
Now, consider the digraph induced by A{t)\ Let 
Gr = {Vr,%) 

be defined by reversing directions of edges of Gr, i.e., 

i ^ j G Er if and only if j ^ i G Er- 

Then, from ( [35] l and ( |36] l, Gr is the digraph induced by A{t). 
Furthermore, since Gr is strongly connected, so is Gr- In 
summary, we have that 

1. The induced digraph of A{t) is Gr for all f > 0, and Gr 
is strongly connected. 

2. Following ( [3^ , there is a uniform lower bound 5 > 0 
such that 

aij{t) >6, yt >0 and Vt —>■ j G Er- 

Then, it is known from | [^ that the transition matrix $(f) of 
the linear system ( |38l l converges to a rank one matrix: 

lim $(f) = 1 • 

t—>-oo 

where 1 G is a vector of all ones, and u is a vector in the 
{k — l)-simplex. Hence, the solution y(t) also converges: 

lim y{t) = {u,y{0)) ■ 1. 

r—>-oo 

It suffices to show that the convergence of y{t) implies the 
convergence of x'{t) of system To see this, first note 
that Qr is positive invariant, and hence, 

Xi{t) G [0, a], Vf > 0 and Vi G Vr- 

Since a < 1/2, the function (1 — x)x is invertible when 
restricted to the closed interval [0, a]; indeed, (1 — x)x is 
strictly monotonically increasing when restricted to [0, a]. 
Thus, if yiit) = {1 — Xi{t))xi{t) converges, then so does Xiit), 
for all i GVr- On the other hand, from Proposition |U there is 
only one equilibrium point x* in Qr', we thus conclude that 
x'{t) converges to a:'*, and hence x{t) converges to x*- This 
completes the proof ■ 


The diagonal entries of A{x') are set to be —(1 — 2.Xi), for 
i G Vr- With the matrix A{x'), we can rewrite system ( |3U 
into the following matrix form: 

y = A{x')y- (37) 

With the definitions and notations above, we next prove 
Proposition |U 

Proof of Proposition We first establish the convergence of 
system (HU, and then show that it implies the convergence of 
sysem Hi- 

Fix an initial condition x(0) G Qr, and let x{t) be the 
solution of system H). Then, system HU can be viewed 
as a time-varying linear consensus process, with A{x{t)) 
(or simply written as A{t)) the time-varying infinitesimally 
stochastic matrix, i.e.. 


D. Proof of Theorem 

We provide in this subsection a complete proof of Theo¬ 
rem [T] We first recall that a is a scalar (defined in ( [TU ) given 


2 4(2n-3)’ 

We also recall that Q, Qr are subsets of Sp[IV], given by 
Q = {x G Sp[y] \ Xi < a,y i G V} 

and 

Qr = Q n Sp[v/]- 

To prove Theorem we further need the following: for a 
vector V = {vi,.--,Vn) G K", let the one-norm of v be 
defined as follows: 

n 

Iklli := E 

2=1 


y = A{t)y. 


(38) 






then, the following holds: 

Lemma 6. Let x be in Q with fa'' ^ — 1/4/ 

then, there exists a point x' in Qr such that 

||a; — x'\\i < 2e. 


Proof. We first show that 

Y.{a-Xi)>l/L (40) 

ieVr 

This holds because < 1, and 

o 3 3 5 

a > 3a =-^-r > 

2 4(2n- 3) “ 4 

The first (resp. last) inequality holds because |14| > 3 (resp. 
n > 3). Since e < 1/4, from ( |40l i, there exists a vector x' G Qr 
such that a;' > Xi for all i G Vr, and moreover, 

-Xi) = x^. 

ieVr i^Vr- 

It then follows that 

||x' - x||i = 2 Xj < 2e, 

i(fVr. 

which completes the proof. ■ 

We are now in a position to prove Theorem 

Proof of Theorem Parts 1 and 2 of Theorem [T] are estab¬ 
lished by Corollary [T] and Proposition]^ respectively. We prove 
here Part 3. 

First, we show that there is an open set U in Sp[C] 
containing Qr such that if x(0) G U, then the solution x(f) 
of system 0 converges to x*. By Proposition the non¬ 
vertex equilibrium point x* is exponentially stable. Thus, there 
exists an open neighborhood Ux* of x* in Sp[C] such that if 
x(0) G Ux-, then x{f) converges exponentially fast to x*. 
Now choose a point x G Qr- From Proposition we know 
that there exists an instant T > 0 such that if x(0) = x, then 
x(<) G Ux> for all t > T. This, in particular, implies that 
there exists an open neighborhood Ux of x in Sp[C] such that 
if x(0) G Ux, then x{T) G Ux* - Now, define 

U := Gix^QrUx- 

Then, U is the desired open set of Qr in Sp[y]. 

Next, we show that there exists an e > 0 such that if x lies 
in Q and satisfies x G U- Since Qr is 

a compact subset and U is an open set containing Qr, there 
exists an e' > 0 such that the P-neighborhood of Qr in Sp[C] 
is contained in (7. Specifically, let 

U' ■-= {x G Sp[C] I ||x — x'lli < e' for some x' G Qr}', 

then, U' C U - Now, choose e positive but sufficiently small 
such that 

e < min{e'/2,1/4}. 


Then, from Lemma we have that for any x G Q with 
< L there exists a x' G Qr such that 

||x — x'll < 2e < P , 

which implies that x G U' C U- 

We now show that any trajectory x(f) of system 0 inter¬ 
sects the open set U - Note that if this is the case, then by using 
the arguments as before, we know that x{t) converges to x*. 
To establish the statement, we first note that from Corollary 
there is an instant Ti such that x{t) G Q for all t > Ti. We 
also note that from Proposition there exists an instant T 2 
such that 

y^Xi(f)<e, yt>T2- 

i^Vr 

Thus, if we let T := max{Ti,r 2 }, then x{t) G Q and 
< e for all t > T, which implies that 

x(f) gU, Vf > T. 

This completes the proof. ■ 

VI. Conclusions 

In this paper, we have introduced a continuous-time model 
whereby a number of agents in a social network are able to 
evaluate their self-appraisals over time in a distributed way. We 
have shown that under a particular assumption (Assumption]^, 
the solution of the system converges to the unique non-vertex 
equilibrium point x* as long as the initial condition is not a 
vertex, and moreover, x* is exponentially stable. This stable 
equilibrium point can be interpreted as the steady state of the 
self-appraisals of the agents, and we have related the value of 
each X* to the values of cji, as described by Proposition]^ and 
Corollary ]^ 

Future work may focus on the case where each is 
time-variant. For example, we can assume that each also 
depends on the self-appraisal of Xj, e.g., how much opinion 
agent i accepts from agent j now depends on how influential 
agent j is in the social network. Also we note that this model 
can be developed into many other interesting problems. For 
example, a question related to sparse systems is that given 
the underlying graph G, what is the collection of achievable 
steady states x* by the choice of c^’s? A similar question 
has been asked and answered in the context of the consensus 
process ID- Another problem related to optimal control is 
to assume that there is an agent i who is able to manipulate 
her own weights Cij, and we ask whether there is a choice of 
these weights so that self-appraisal of agent i is maximized? 
If further, we assume that there are two such players each of 
whom is trying to maximize her own self-appraisal, then what 
would be the strategy for each of the players to choose the 
Cij’s? This list of examples indicates that the self-appraisal 
model has a rich structure which can be investigated under 
various assumptions and from different perspectives. 
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Appendix 

We prove here Proposition[^ We first have some definitions. 
A polynomial m{xi, ..., x„) is said to be a monomial if it 
can be expressed as follows: 

m{xi, ...,Xn)= 

with ki > 0 for all f The degree of the 

monomial m{xi,..., Xn) is defined to be X]r=i ^ poly¬ 
nomial p{xi,... ,Xn) can be uniquely expressed as a linear 
combination of monomials. We say a monomial is contained in 
p if the corresponding coefficient is nonzero. Furthermore, the 
degree of p is defined to be the highest degree of a monomial 
contained in p. With these definitions at hand, we have the 
following result: 

Lemma 7. Let a:(0) be any initial condition of system 01 
in Sp[V]. The time derivative xf{0) is a degree-{k 1) 
polynomial in Xj{0), for j € Si{k), and it does not contain 
a constant term. Moreover, if Di{k) is nonempty for k > 1, 
then the following properties hold: 

1) The only monomials in variables 2:^(0), for j € Di{k), 
contained in xf\t) are 

a;j(0) and Xj(0), Vj € Di{k). 

2) The coefficients of Xj{0) and Xj(0), for j G Di(k), in 
xf{0) are aji and —aji, respectively. 

ik) 

Proof. In the proof, we will simply write x\ by omitting the 
argument. The proof will be carried out by induction on k. 
Base case. We assume that fc = 1; in this case, we have 

xf = -(1 - Xi)x, + Cj,(l - Xj)Xj. 

j&v+ 

We recall the fact that 

.5,(1) = U {z} and 0,(1) = V+, 
and the fact that 

Oiji = Cji, Vj € V) . 

It then follows that Lemma |7] holds for fc = 1. 

Inductive step. We assume that Lemma|^holds for (fc — 1), 
and prove for fc. We first show that xf is a degree-(fc -|- 1) 
polynomial in variables xfs, for j G Si{k), and it does not 
contain a constant term. 

Label the elements of Si{k — 1) as ii,...,is. By the 
induction hypothesis, we can write as follows: 

t 

(k-l) 

x\ ' = (Tqrriq. 

9=1 


Each niq is a monomial in variables Xi^^,... ,Xi^, and is 
the associated coefficient. The degree of niq is at most k. By 
chain rule, we have 


„(fc) 


= EE' 

9=1 P=1 


diriq 

' dxi^ 


Xix)- 


(41) 


Note that each fi^ (x) (defined in ( [T0| l) is a degree-2 polyno¬ 
mial in variables Xj, for j G Si (1), and it does not contain 
a constant term. Also, note that since ip G Si{k — 1), each 
S'ip(l) is a subset of Si{k). Thus, by following •ED, we know 
that (i) is a polynomial in variables Xj, for j G S,{k); (ii) 
the degree of x] is at most [k + 1); and (iii) x] does not 
contain a constant term. Further, a direct computation yields 
that the monomial x^^^ is contained in with coefficient 
k\. Thus, the degree of x^^'^ is ik -I- 1). 

We now assume that Di{k) is nonempty, and establish 
items 1 and 2 of the lemma. First, note that each dmqjdxi^ 
is a monomial in Xj, for j G Si{k — 1). Hence, if 
{dmq/dxi^)fi^{x) contains a monomial in Xj, for j G Di{k)', 
then, we must have 

ruq = Xi^ (42) 


so that dniq/dxi = 1, and moreover, fi (x) has to contain a 
monomial in Xj, for j G Di{k). On the other hand, fi^{x) is 
a polynomial in variables Xj, for j G From Femmaj^ 

if S'ip(l) intersects Di{k), then 


ipGDi{k-l). (43) 

Combining ( |42| ) and ( |43| ), we know that contains at most 
Xj and x^j, for j G Di{k), as the monomials in Xj, for j G 
D,{k). 

Now, fix a vertex j G Di{k), and let cr' and tr" be the 

o f Ai *) 

coefficients of Xj and Xj in . It suffices to show that 
(Tj — tXj i and — (y. j ^. 

First, from Femma ll V~ intersects Si{k — 1), and their 
intersection lies in lJi{k — 1). We thus define 


W:= D,(k-l)nV~. 

Then, using the fact that {dmq/dxi^)fi^{x) contains the 
monomials Xj and x| if and only if uiq = Xi^ and ip G W, 
we obtain that 


/ // \ ^ 

ip&W 

where cr, is the coefficient of x, in From the 

t'p f'p X 

induction hypothesis, we have (Ji^ = ai^i, and hence 

= ~^j = E 

ip^W 

which is ttji by 0. This completes the proof. ■ 

With Femma |7] at hand, we now prove Proposition 

Proof of Proposition We first prove for the case where 
there does not exist a supporting path for i at x(0). The fact 
that i fi Vp follows from Femma To see this, we assume 


that i G Vp. But then. Si = V, and hence, Xj(0) = 0 for all 
j G V, which contradicts the fact that x(0) G Sp[14]. We now 
show that 


Xj{f) =0, Vf > 0 and Vj G Si. (44) 

Note that the dynamics of Xj depends only on x^’s for k G 
Sj{l). Since j G Si, we have Sj{l) C Si. This, in particular, 
implies that the following system: 

Xj = -{1 - Xj)xj + ^ Ckjil - Xk)xk, Vj G S'i (45) 
kevf 

formed by Xj’s, for j G Si, is an isolated system, independent 
of Xji, for j' f Si. Since there is no supporting path for i at 
x(0), by Femma 1^ we have 

Xj(o) = o, yj G Si. 

But then, following this initial condition, ( |44l i is the unique 
solution of system ( |45] l. 

We now prove for the case when there exists a critical 
supporting path for i at x(0) of length k. We first show that 
xf\o) = 0 for all I < k, and then show that x^^^(O) > 0. 
By Femma 1^ is a polynomial in Xj{0), for j G Si{l), 

and it does not contain a constant term. Since the length of a 
critical supporting path for i at x(0) is k, we have Xj{0) = 0 
for all j G Si{l). Thus, xf^(O) = 0 for all I < k. 

We now show that x^^^(O) > 0. Since there is a critical 
supporting path for i at x(0), Di{k) is nonempty. Then, by 
Femma 1^ we have 

Since x(0) is not a vertex of Sp[F], we have Xj{0) < 1 for 
all j G V. On the other hand, there exists at least a vertex 
j G Difk) such that Xj(0) > 0. This holds because there 
exists a critical supporting path for i at x(0) of length k. It 
then follows that x^^^ (0) > 0, which completes the proof. ■ 




